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Abstract 

We extend some aspects of the Hamilton-Jacobi theory to the category of stochastic Hamiltonian 
dynamical systems. More specifically, we show that the stochastic action satisfies the Hamilton- 
Jacobi equation when, as in the classical situation, it is written as a function of the configuration 
space using a regular Lagrangian submanifold. Additionally, we will use a variation of the Hamilton- 
Jacobi equation to characterize the generating functions of one-parameter groups of symplectomor- 
phisms that allow to rewrite a given stochastic Hamiltonian system in a form whose solutions are 
very easy to find; this result recovers in the stochastic context the classical solution method by 
reduction to the equilibrium of a Hamiltonian system. 

Keywords: stochastic differential equation, Hamiltonian stochastic differential equation, Hamilton-Jacobi equation. 

1 Introduction 

Hamiltonian diffusions were introduced and studied by Bismut in the monograph [B81j . These systems 
were generalized in [LO07] to accommodate arbitrary Poisson manifolds as phase spaces and general 
continuous semimartingales as forcing noises. In that paper it was also shown that, when the phase 
space is an exact symplectic manifold, the stochastic Hamilton equations are fully characterized by a 
variational principle that generalizes the classical Hamilton's Principle. This circle of problems has also 
been treated in |BRO08j in the development of stochastic variational numerical integrators. 

Hamilton-Jacobi theory is an important part of classical mechanics that provides a characteriza- 
tion of the generating functions of certain time-dependent canonical transformations that put a given 
Hamiltonian system in such a form that his solutions are extremely easy to find; this is the so called 
solution by reduction to the equilibrium. In this respect, the fact that the classical action satisfies the 
Hamilton-Jacobi equation is a very relevant result. Hamilton-Jacobi theory also plays a fundamental 
role in the study of the quantum-classical relationship, in integrable systems, or in the development of 
structure preserving numerical integrators. For all these reasons it is desirable to have at hand similar 
tools in the stochastic Hamiltonian context; this is the main goal of this work. The Hamilton-Jacobi 
equation was already studied by Bismut [B81J in the context of Hamiltonian diffusions and, as we will 
see, most of the ideas in that piece of work are still valid at our degree of generality; at some level, this 
paper can be seen as a completion of Bismut 's work in which complete proofs are provided and where 
the results have been adapted to our framework using a more modern geometric language; this makes 
them more palatable to a growing community interested both in geometric mechanics and in stochastics. 

The paper starts with a brief presentation in Section [2] of some basic facts about stochastic Hamil- 
tonian systems and, more importantly, with the introduction of the stochastic Hamiltonian action. Sec- 
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tion[3]is dedicated to showing that the stochastic action satisfies a generalized version of the Hamilton- 
Jacobi equation when written as a function of the configuration space using a Lagrangian submanifold 
(see Theorem I3.5|) . As an application of the results in this section we show in Example 13.71 how the 
exponential of the expectation of the so called projected stochastic action can be used to construct solu- 
tions of the heat equation corrected with a potential, in a way that strongly resembles the Feynman-Kac 
formula. 

The paper concludes with a section on the relation between the solutions of the Hamilton-Jacobi 
equation and the generating functions of time dependent diffeomorphisms that allow the integration of 
the Hamiltonian stochastic differential equation in question in an easy manner. The natural framework 
for carrying this out is that of time-dependent Hamiltonian systems; that is why we have included a 
subsection that briefly recalls the classical theory of non-autonomous Hamiltonian systems and presents 
it in a form that is suitable for generalization in the stochastic context. Some of the statements in 
this section are either inspired or are a direct generalization of analogous results in [B81J; we have 
nevertheless included them in order to have a complete and self-contained presentation of the theory. 

Acknowledgements: the authors thank the hospitality of the Centre de Recerca Matematica of the 
Universitat Autonoma de Barcelona during the program "Equivariant Problems in Symplectic Geome- 
try" , organized by Eva Miranda. This paper was written while the authors took part in that program. 
J. -A. L.-C. acknowledges support from the Spanish Ministerio de Education y Ciencia grant number 
BES-2004-4914. He also acknowledges partial support from MEC grant BFM2006-10531 and Gobicrno 
de Aragon grant DGA-grupos consolidados 225-206. 

2 Stochastic Hamiltonian dynamical systems and the stochas- 
tic action 

In this section we recall the basic facts about stochastic Hamiltonian dynamical systems and we fix the 
notation that we are going to use throughout the paper. The content of this section is extracted from 
LO07 , which the reader is encouraged to check with for a more comprehensive approach to stochastic 
Hamiltonian systems and their most relevant properties. Although such systems may be considered 
on any Poisson manifold (M, {•, •}), we are only going to deal with the exact symplectic case, that is, 
stochastic Hamiltonian systems defined on exact symplectic manifolds. 

The reason for such a restriction is that in that case there exists a stochastic action defined on the 
set of manifold valued semimartingales such that the stochastic Hamilton equations can be characterized 
using a critical action principle. In other words, taking suitable variations on the space of manifold 
valued semimartingales, a given semimartingale is critical for the stochastic action if and only if it is 
a solution of the stochastic Hamiltonian equations. This generalizes to the stochastic context the way 
in which the Hamilton equations are characterized in the classical deterministic contex. Like in that 
framework, the stochastic action plays a prominent role in the description of a Hamiltonian system and, 
as we will see later on, it also satisfies a stochastic analog of the Hamilton-Jacobi equation. 

Let (M,u>) be a symplectic manifold. Using the nondegeneracy of the symplectic form ui, one can 
associate to each function h £ C°°(M) a vector field Xh 6 X(M) characterized by the equality 

\ Xh uj = Ah (2.1) 

We will say that Xh is the Hamiltonian vector field associated to the Hamiltonian function h. The 
expression (|2.1[) is referred to as the Hamilton equations. Given h £ C°° (M), solving the associated 
Hamilton equations amounts to finding the integral curves of Xh ■ 

We now introduce the stochastic generalization of (|2.ip . Let V be a real finite dimensional vector 
space and let / : M — ► V be a differentiable function taking values in V. We define the differential 
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d/ : TM -> V as the map given by df = p 2 o Tf, where Tf : TM TV = V xV is the tangent map of 
/ and P2 ■ V x V — > V is the projection onto the second factor. If V = R this definition coincides with the 
usual differential. If {ei, e r } is a basis of V and / = Y^i=i f %e i> /* e < -^° C^Oj tnen d/ = Si=i &f %e i- 
A Stratonovich operator from 1/ to M is a family {S(v, z)} V £V,zeM such that S (v, z) : T V V — > T Z M 
is a linear mapping that depends smoothly on its two entries. The adjoint of S («, z) is usually denoted 
by S* (v, z) : T*M -> T*V, v £ V and z £ M. Given a smooth function h : M ^ V, h — £- =1 Ve;, we 
define the associated Hamiltonian Stratonovich operator (w, 2) : T„V — ► T Z M by 

T" 

= ^(e i ,u)X hi (z), (2.2) 

In this expression, {e , ...,e r } is the dual basis of {ei, e r }. It is easy to check that the adjoint 
H*(v,z) : T*M -> T;i/ of i?(u,2) is H*{v 7 z) (a z ) = -dh(z) ■ uj*{z) (a z ), where J{z) : T*M -> T 2 M 
is the isomorphism induced by the symplectic form w. 

The key to generalizing the Hamilton equations (|2.1j) to the stochastic context consists of realizing 
that they may be restated by saying that a smooth curve 7 : [0, T] — > M is an integral curve of the 
Hamiltonian vector field Xh, h g C°° (M), if and only if for any a g f2 (M) and for any t g [0, T] 

a=- f dh(uj*(a)) o 1 (s)ds (2.3) 

Tl[o,T] ■'O 

f |LO07| Proposition 2.1]). Using this observation we will define the stochastic Hamilton equations by 
specifying the result of integrating an arbitrary one form a £ ft (M) along them. More especifically, let 
(fi, {J r t } t£ R + , P) be a filtered probability space, X : R + x — > V a continuous semimartingale (that 
is, the paths X t (•) : £1 — > V are continuous a.s. for any t £ R+) that takes values on the vector space 
V with Xo = 0, and h ; M — > U* a smooth function. We will say that a M-valued semimartingale 
r : R + x — > M is a solution of the stochastic Hamilton equations with stochastic component X 
and Hamiltonian function h if for any a £ ft (M) 

J (a, sr ) = -J (dh ( u *(a)) , SX) , (2.4) 

where the symbol 5 denotes Stratonovich integration. In other words, the processes that solve the 
stochastic Hamilton equations are no longer driven by the deterministic time t but by the stochastic 
noise X. It can be shown ( |E89| Theorem 7.21]) that given a semimartingale X in V, a J^-measurable 
random variable To, there are a maximal stopping time £ > and a continuous solution T of (|2.4|) with 
initial condition T defined on the set {(t, 77) £ R+ X fi | t £ [0, CC 7 ?))}- If C is finite, then T explodes at 
time £, that is, the path T t with t £ [0, C) is not contained in any compact subset of M. For the sake of 
simplicity, the stochastic Hamilton equations (I2.4|) will be symbolically denoted using the Stratonovich 
operator H as 

6T = H(X,T)6X. (2.5) 

We now state some of the basic properties of the flow defined by (|2.4|) . Let <p(-,z) : [0,C( Z )) Q 
R + x O — ► M denote the unique solution of (|2.5p with initial condition Tq = z £ M a.s.. The 
map ip will be referred to as the stochastic flow associated to (|2.5I) . For any (t,rf) £ R+ x f2, let 
B t (,7) ={zeM|( (z, 77) > t}. Observe that B t (77) C B s (77) if s < t. By [K90l Lemma 4.8.3] P 4 (77) is 
an open set for any t £ M + a.s. and 

<pt (77) : D t (77) — » M 

z 1 — > ipt(z,V) 
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is a continuously differentiable diffcomorphism ( K90, Theorem 4.8.4]). Additionally, 

<p (77) : [0, t] x D t (77) — > M 

z 1 — > ft(z,v) 

is continuous and its partial derivatives with respect to z 6 D ( (77) are also continuous on [0,i] x D t (77). 
The local version of these results, that is, the case M = R 2 ™, can be also found in |P04[ Chapter V 
Theorem 39]. Furthermore, the stochastic flow ip acts naturally on tensor fields and in particular on 
differential forms. Hence, by [K8T1 Theorem 3.3] and [K90l Section 4.9], if a e (M) is a fc-form, 
k e N, then 

^ (»?)* a = a + J2 [I ft (£x hi a) SX]j (77) (2.6) 

on B t (77), (t,rj) G K4- x f2. In particular, if a = a; is the symplectic form, then £x h .^ — for any 
i = 1, ...,r and 93*0; = u> which is the stochastic version of the Liouville's Theorem (see |LO07[ Theorem 
2.1]). 

We conclude this brief summary on stochastic Hamiltonian systems by introducing the stochastic 
action and presenting how it characterizes the solutions of the Hamilton equations. As we already 
said, the stochastic action is only naturally defined for stochastic Hamiltonian systems occurring on 
exact symplectic manifolds: let (M, u> = —d9) be an exact symplectic manifold, X : R + x ft — > V a 
semimartingale taking values on the vector space V, and h : M — ► V*& Hamiltonian function. Wc 
denote by S (M) and S (R) the sets of M and real valued semimartingales, respectively. We define the 
stochastic action associated to h as the map S : S (M) — > S (R) given by 

S(T) := J (6, ST)- J(h(T),5X) 

where in the previous expression, the stochastic differential form h (T) : R+ x ft — > V x V* over X is 
given by h (T) (t, u) := (X t (u) , h (T t (w))). 

Given a M-valued semimartingale T and so > 0, we say that the map S : (— sq, so) x K + xfl-»M 
is a pathwise variation of T whenever S^ 0-0 = T t a.s.. We say that the pathwise variation S of T 
converges uniformly to T whenever the following properties are satisfied ( |LO07|, Definition 4.4]): 

(i) For any / £ C°° (M), /(S s ) — > /(T) uniformly in compacts in probability (abbreviated in 
ucp) as s — > 0. That is, for any e > and any £ £ R + , 

P({ sup |/(Si)-/(T u )|>e}) 

(ii) There exists a process V : M + x!l^ TJkf over T such that, for any / e C°° (M), the Stratonovich 
integral J Y[f]5X exists for any continuous real semimartingale X (this is for instance guaranteed 
if Y is a semimartingale) and, additionally, the increments (/ (S s ) — / (T))/ s converge in ucp to 
Y[f] as s — > 0. We will call such a Y the infinitesimal generator of E. 

We will say that S (respectively Y) is bounded when its image lies in a compact set of M (respectively 
TM). It can be shown that, given a M-valued semimartingale T, a compact set K C M, and a bounded 
process Y : M + x O — > TM over r TK (the process T stopped at the first exit time tr- of T from 
ii") such that / Y[f]5X exists for any continuous real semimartingale X and any / £ C°° (M), there 
exists a bounded pathwise variation £ that converges uniformly to r rff whose infinitesimal generator 
is Y f [LO07[ Proposition 4.2]). Using these elements, a variational characterization of the stochastic 
Hamilton equations can be given ( |LO07[ Theorem 4.2]): the semimartingale T satisfies the stochastic 
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Hamilton equations (|2.4p with initial condition Tt=o = m o € a.s. up to time tr- if and only if, for 
any bounded pathwise variation E : (so, So) x K + xfl->M with bounded infinitesimal generator which 
converges uniformly to T TK and such that Eg = mo and E£ = r Tfc a.s., s G (— So, so)j 



' d_ 

ds 



5(E S ) 



a.s.. 



s=0 



3 The stochastic action on Lagrangian submanifolds and the 
Hamilton-Jacobi equation 

It is a classical result in mechanics that the action, when written as a function of the configuration space 
and time, satisfies the Hamilton-Jacobi equation (see for instance [A89 ). The main goal of this section 
is showing that an analogous result holds for the stochastic action. 

Let ifit(v) '■ ^>t (v) ~~ * M be the flow associated to the stochastic Hamilton equations (|2.5| . (t, 77) G 
K + x fl. We define the function R t (77) : O* (77) — > R as i?t (77, z) := 5* (z))t (r/). The next proposition 
provides the differential of i?t (77). 



Proposition 3.1 Let rj G R+ fee a /irrec? time instant and 77 G Q. Then Rt (77) : U>t (n) — > M is differen- 
tiable and 

dR t (T 1 )=^(n)*8-9, (3.1) 
where 9 is the one form of the exact symplectic manifold (M,ui = —d.9). 

Proof. We will proceed by showing that for any pair of points x, y G D f (77) we can write 

R t (r ] , X )-R t (r 1) y)= f { Vt (r,)* (9) - 9) , 



where 7 : (a, b) C M — > D t (77) is any smooth curve in D t (77) that links 2 and y. This expression 
immediately implies that i?t has continuous directional derivatives and it is hence Frechet differentiable. 
Indeed, using first (|2.6[) . we have 



(77) , 



^ _ _ _ (3-2) 

where in the second equality we used Fubini's Theorem. Now, since ix h .u = dhi, for any i = l,...,r, 
equals 



g (I (// :d M) 5Xi *-f (l/* dh ) ^) w 

- 1 (f (/ d (*<M) «2 - / ( / d(*fc)) «2) (,) 



£ (jf (v-M) - ^ (^ ( 7o ))] - J* [hi (<p s ( lb )) - hi (Mia))} SX^j (77) 

f (9, S Vs ( 7fe )) - jf (h (<p s ( 7b )) , 5X S }) (77) - (J (9, Scp s ( 7a )} - jf (h (<p 3 ( 7a )) , <5X S }) (77) 



i? t (77, x) - R t (77, y) . 
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Given that 7 : (a, 6) — > D f (77) and the points (77) are arbitrary, the result follows. ■ 

Later on in this section we will need the composition of R with the inverse of the stochastic flow (p. 
More specifically, let (t, 77) G K + x fi and let ip^ 1 (77) : <p t (77) (D t (77)) — > D t (77) the inverse of <p t (77). We 
define fl t (77) : <p t (77) (D t (77)) -> D 4 (77) as # t (77) := i? f (77) o tp' 1 (77) = y^ 1 (77)* (R t (77)). Consequently, 

(77) = p- t x (77)* (di? t (77)) = ^ (77)* (77)* (0) - 0) = - ^r 1 (77)* (0). (3.3) 

In order to get closer to the classical deterministic result on the Hamilton-Jacobi equation we are 
first going to visualize it, using the map R, as a process depending on M through the initial condition 
of the flow <p generated by (|2.5p . Second, we will restrict R to a Lagrangian submanifold of M; this 
encodes mathematically the writing of the action as a function of the configuration space. Recall that a 
submanifold 1 : L M of a symplectic manifold (M, cj) is called Lagrangian if dim (£) = dim (M)/ 2 
and t*w = 0. Observe that since pt {v) i s a symplectomorphism a.s. for any t £ R+ and D t (77) is an 
open set, if L is a Lagrangian submanifold so are L PI D t (77) and y; t (77) (L n B t (77)). 

From now on we are going to assume that the underlying symplectic manifold (M, to) is actually 
a cotangent bundle endowed with its canonical symplectic structure. More specifically, M — T*Q for 
some manifold Q. In this case, a point y e L C T*Q in a Lagrangian submanifold L is said to be a 
regular point of L, if the restriction ir\ L : L — > Q of the canonical projection 7r : T*Q — * Q to L is 
a local diffeomorphism at y (that is, T y ix\ L : T y L — > T^^Q is an isomorphism). In a neighborhood 
?7 C L of a regular point y & L we can obviously describe the Lagrangian submanifold i using local 
coordinates on the base manifold Q, which we will generally denote by (q 1 , . . . , q n ). On the other hand, 
since l*lu = d(i*9) = 0, there exists by the Poincare lemma (shrinking U if necessary) a smooth function 
/ G C°° (U) such that t*0 = d/. Conversely, if (g 1 , . . . , q n ,pi, . ■ ■ ,p n ) are local Darboux coordinates in 
a neighborhood V C T*Q and / G C°° (ir(V)) is a function with no critical points, then the set 

L f = {(q,p)eV\ Pi = ^, 7 = 1, Til (3.4) 



is a local Lagrangian submanifold such that 

f f d = n\l f df, (3.5) 

with if : Lj <—* V the inclusion and k\l s '■ Lf C T*Q — > 7r(V^) the local diffeomorphism obtained by 
restriction of the canonical projection. 

Theorem 3.2 Let Q be a manifold and let L C T*Q a Lagrangian submanifold. Let yo G L be a 
regular point and let xo = n{yo), where tt : T*Q — > Q is the canonical projection. Then, there exist two 
neighborhoods V yo C L and V Xo C Q of yo and of xo, respectively and a map £ : f2 x V Xo — > with the 
property that £ (x) : — > K.+ is a stopping time, such that the equation 

n{<Ps{ri,y)) = x (3-6) 

/ias a unique solution in V yo C Z, /or any 77 G f2, anj/ x G V Xo , and any s G [0, £ (77, a;)] . We are going 
to denote this solution by ip s (77,2;). Moreover, ip (x) : [0, £(x)) — > V yo (77) is a semimartingale for any 
x G V XQ and ip s (77) : V xo — > Vj, is a diffeomorphism for any s G [0,£ (x)) which depends continuously on 
s. 

Proof. Let [/^ c L be an open neighborhood of yo G £. We pick /7j, small enough so that ^\u yo is 
a diffeomorphism onto its image and a set of local coordinates (g 1 ; i = 1, n) can be chosen on U Xo :— 
tt(U Vo ). Let (y l = q l o tt\ l ;i = 1, ...,n) be the corresponding induced coordinates on U yo . Denote by 
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q : U Xo — > M. n and y : U Vo — ► R n the local chart maps associated to these coordinates. For any y € U yo , 
let tu (y, 77) = inf{/j > | Troip t [n, y) £ U XQ } be the first exit time at which the semimartingale nop (y) 
leaves U xo . Let F be the restriction of ttolp to the set A := {(s, 77, y) G R + x ft x [7^ | s G [0, n/ (y, ^))}- 
In local coordinates, F : A — > is expressed as 

F l (V) (y 1 , -,y n ) =q 1 oiroLp s (77) of 1 (y 1 , ...,y n ) , j = 1, ...,n. 

Now, remark that det ^ (yo)) / a.s. because i/n e L is a regular point. The continuity of 
the derivative of Fq (77) : U yo — > C/ Xf) implies that there exists a neighborhood V^ C [/ yo such that 
det 

T^t"^ > a - s -j f° r an y V G ^yo- Far any of these y € V^ Q , let 

Z(y):=det(fi(y)) : [0,tv* o (v)) — K 

(a, 77) — ► det(^i(y)), 

which is a well defined and continuous semimartingale, by the continuity of the differential of the flow 
<p. Observe that Z (y) > for any y G V yo . Let T (y, rj) := w£{t Uxq (y) > t > | Z t (y, rj) <£ R+}. 

Now, recall that we want to see that the equation ir (ip s (77, y)) = x has a unique solution in y G L, 
for any a; G V Xo in a suitable 14 and up to a suitable stopping time £ (x). Therefore, it suffices to solve 
the equation 

n(fM{r 1 ,y))=x, (3.7) 

where (^ T ^^ (y) denotes the process ty? (y) stopped at time T (y), that is, t^ 7 ^) (y) (s, 77) = (pT(y,n)As (v> V)- 
Observe that ip T ^ (y) is always in U yo if y was already in V yo . Consequently, ip T ( yS> (y) may be described 
using the local coordinates introduced above. Moreover, if we set £ (x) := T ^ 7r| (x)^ , T4 := 7r(V^, ), 

the equation (|3.7p admits by construction a unique solution t/> s (77, x) via the Implicit Function Theorem. 
Additionally, if we apply the Stratonovich differentiation rules to 

7T (v T s (v) {V, (v, a?))) = s G [0, f (a, 77)) 
we obtain that %p s {rj,x) satisfies up to time £ (x) the Stratonovich differential equation 

r 

5ip s {x) = [T^FY 1 (r :h)(Wi)) (?oi) (XhtitfM (M*))))) SX] (3.8) 

i=l 

with initial condition ^> s= o(x) = y{%) € V^, a.s. such that 7r(y(x)) = x G V Ko . That is, we can 
visualize ip s (j],x) as the unique stochastic flow associated to the stochastic differential equation (|3 . 8|) . 
This guarantees that the properties claimed in the statement hold. I 

We proceed now by considering the stochastic action R not as a semimartingale parametrized by 
T*Q through the initial condition of the stochastic flow if defined by (|2.5p . but as a process depending 
on the base manifold Q. More specifically, we will restrict to the open neighborhood V XQ C Q introduced 
in the statement of Theorem 13.21 and which is mapped onto V VQ C L using the map if> that solves (|3.6p . 
Furthermore, since we are always going to work around regular points of the Lagrangian submanifold, 
we will always consider Lagrangian submanifolds of the type Lf (see (|3.4p ) for some / G C°° (Q). 

Definition 3.3 Let Lt C T*Q be a Lagrangian submanifold. f G C°°(Q). Let V Xf) C Q be the open 
neighborhood of Xg introduced in Theorem \3.S\ and ip(x) : [0,£(x)) — ► V ya the semimartingale solution of 
\3. 8\) with initial condition x G V Xo a.s.. We define the projected stochastic action S (x) : [0, £(x)) — ► 
R as 

S t (77, x) = R t (77, ip t (r), x)) + f (tt (ip t (v, x ))) = (Rt (rj) + f ^t(»7, x). 



Lazaro and Ortega: The stochastic Hamilton-Jacobi equation 



8 



Notice that the differentiability properties of the maps R, f £ C°° (Q), and ip imply that the map 

S t (r,) :Bf(ry) — R 



(3.9) 



is continuously differentiable for any (t,rf) £ R+ x f2 such that i £ [0, £ (x, 77)). In this expression 
Bf (77) := {a; e V Xo | t < £ (x,rf)}. The following theorem provides an explicit expression for the spatial 
derivatives of the projected stochastic action S. 

Theorem 3.4 Let Lf be a Lagrangian submanifold ofT*Q, f £ C°°(Q). Then, on the open set Bf 

(t, 77) el+xfl, 

&S t (ri) = {ipt{ri)oi> t {rj))*6. (3.10) 

// (q l ,Pi',i = 1, n) are local Darboux coordinates ofT*Q on an open neighborhood of a regular point 
yo £ Lf, the expression US. 1 0\) can be locally written as 



dq 1 



(q) = Pi ((fit (?7, ipt(v, 9))) , 7 = 1, 77. 



Proof. First of all observe that St (77) can be expressed in terms of Rt (77) as follows: 

s t iv, 9) = R\ (v) ft (v) ° A (y, q) + f ° t o %/j t (77, q) . 

Then, for any smooth curve 7 : [a, b] — > ©f (77) 



"5* (»7, 7b) ~ S t (77, 7 a ) = / dS t (77) 



At fo) ft (v) °<Pt(ri) + / d (/ o 7T o ffit (77)) . (3.11) 



Given that Itif (77) C Lf, the curve 7 takes values in the Lagrangian submanifold and hence 1|3.11[) 
can be rewritten as 



St (V , lb) - S t (77, 7 tt ) = / 4 f d R t (rj) o ip t (rj) o ip t (v) + / d (/ o tt o ?/> t (77)) 



Rtii) o Lpt(ti) o^ t (n) o i Lj +/ d(/o7r 0^(77)). (3.12) 



On the other hand, we saw in (|3.3p that 



di? t = - ^ (*?)* (<?)• 
Moreover, since = 7r| ^ d./ we have that 

d Rt (77) O (ft (77) O ?/> t (77) O L Lf = ((ft (77) O Ipt (J?) tL/)* - d (/ TT O ^(77)) , 

which substituted in (|3.12p yields 

& (v,ib) - s t (77,7a) = / (ft (v) i>t{ri) °iL f )*Q = / (v« (»?) 



Since 7 is an arbitrary smooth curve, we can conclude that 

dS t (v) = (ft (r?Wt (77))* 6, 

as required. I 

We conclude this section by proving that the projected stochastic action St satisfies a specific stochas- 
tic differential equation which generalizes the classical Hamilton-Jacobi equation. For obvious reasons, 
this equation will be referred to as the stochastic Hamilton-Jacobi equation. 
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Theorem 3.5 (Stochastic Hamilton-Jacobi equation) Using the same notation as in Theorem 
3. 21 the projected stochastic action S (q) : [0, £(#)) — > R associated to the Lagrangian submanifold 
Lf defined by the function f G C aD (Q) satisfies 

S(q) = f(q)- [ (h(q,^(q)) ,SX S \ 



dq 

for any q G V xo . 

In order to prove this theorem we need the following auxiliary result. 



Proposition 3.6 ([K90, Theorem 3.3.2]) Let F(x) :l + x(l^M,ier, be a family of continuous 
semimartingales parametrized by W n . Suppose that the dependence of this family on the l n parameter is 
at least three times differentiable. In addition, suppose that there exists a process f : R+ x O x R n — > R d 
that satisfies sufficient regularity conditions and a semimartingale X : R + x f2 — > R d such that 



Let g : R+ x fl — > R" 6e a continuous W 1 -valued semimartingale. Then F (g) : R + x 57 — > R defined as 
F id) (t, n) '■= F (dt (v) i *i ??) satisfies 



r „t n „t 077. 

F(g t ,t)-F(g ,0) = J2 (s,g s )SXi +J2 ^ ( 



s,9s)Sgl. 

Proof of Theorem 13.51 First of all observe that using the definition of the function i?t the semi- 
martingale S (q) : [0, £ (q)) — » R may be expressed as 

S (q) = f on oip t (n, q) + R t (?7, ipt(Vr <?)) 

hi) {Vs{z))5Xi 



f o 7t o (77, q) + ^ ( / (ix h;j # 

.7 = 1 ^ 



If we use Proposition 13.61 in the second summand of this expression, we obtain 



S ( 9 ) = / ° W (<?) + E (/ (ix hj e - hj) (<p.Mq))) + J (dRs, 

.7=1 



SiPs (<?)) . (3.13) 



We now separately study the summands in the right hand side of this equation in order to prove the 
statement of the theorem. We start by recalling that by Proposition 13. 1[ dR s = ip'*6 — 9 and hence 



(dR.,81>. («)> = / - 9, («)> ■ (3-14) 
Furthermore, since i*^Q = 7r|£ d/ and the semimartingale ?/> (g) takes values in V yo Q Lf, 

I SA (q)) = f (d {f o tt) , ty« (?)> =/ o 7T o ^ (?)-/(?) . (3.15) 
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We now recall that the semimartingale ip(tp(q)) : [0,£(g)) — > T*Q takes values in the fiber it 1 (q). 
Indeed, by the construction in Theorem 13.21 tp (q) is the semimartingale starting at q such that 

ir(ip s (rj,ip s (r),q))) = q 

for any (s,r]) £ [0, £(<?)). Then, since is a semibasic form we necessarily have that 

(9,8(<p a ty a (?)))) = 0. 

But, using the fact that </? is the flow of the stochastic Hamilton equations (|2.5[) , by Proposition [321 we 
have that for any g £ C°° (M) 

s^(^(g)))=5(i/(?)) + S / *U2](^(^(g)))<^+ / (d( ff o^),^^)) (3.16) 

3=1 

where y (q) d Lf is the unique point such that 7r| L (y(q)) = q- We claim that 



= 



Sbp.ty, (?)))> = ^ f (i Xh /) (^ (^ (<?))W + / (riBM.m • (3-17) 



3=1 



Indeed, since we are working at a local level we can use Darboux coordinates and we can replace 9 by 
^" =1 Pid<f; (|3.17[) is a straightforward consequence of (|3.16[) . If we now plug (|3.14[) . (|3.15p . and (|3.17[) 
into (|3.13p we obtain 

s(q) = /(?)- X) / ^ iMg)))sxi (3.i8) 

3=1 

Finally, we saw in Theorem 13.41 that 

p l {ipt o ip t (V, g)) = ~ | ^ (g) , i = l,-,n, 



on Df (77) = {x G Kr n I £(x,rj) > t}, (t,r)) 6 R+ x S7. For any 77 € SI, the time parameter s in the 

5? 



integrand of (|3 . 1 8|) is always smaller than £ (g, 77) and hence as jff (g) and pi (<p s o ip a (g)) coincide a.s. 



on [0, £(g)) for any i — 1, ...,n, the result follows. ■ 

Example 3.7 Let Q = W l and T*Q = K™ x E" with global coordinates (g l ,p 2 ; i = 1, n). Let 
/ e C°° (R™), /lo G C°° (M 2 "), and hi = pi for any i — l,...,n. Consider the semimartingale X : 
R + x SI — > M n+1 given by (t, w) 1— * (t, Bj , -B"), where (B 1 , B n ) is an n-dimensional Brownian 
motion. That is, = <5 U £, where [-,•] denotes the quadratic variation. Then, the projected 

stochastic action S : M+ x SI x R" — > R built from the stochastic Hamiltonian system on K 2 ™ with 
Hamiltonian fuction h = (ho, hi, h n ) and stochastic component X satisfies by Theorem[ 



st (g) = /(g) - jT (g, ^(g)) * - £; / 

If we transform the ltd integrals in this expression into Stratonovich integrals, (|3 . 19[) reads 



(3.19) 



St (g) = /(g) - 



(3.20) 
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It is not difficult to realize, though tedious to check, that 



so that, since h r = p r for any r = 1, r 



Therefore, disregarding all the finite variation terms in this last expression, we have 



dS_ 

dq i 



E 



d 2 S s 



iq)dB r s ,J dBl 



E 



E 



* «2 



<9<fcv 



{q)5 ir ds 



J i 

* a 2 £, 



'-{Jo dq l dq 
(q)ds, 



■{q)d[B\B l 



where the property 



J HdX, J KdY 


-j 




t Jo 



for arbitrary real semimartingales H, K, X, and Y ( |P04( Chapter II Theorem 29]) has been used. 
Taking expectations in both sides of (I3.20|) and assuming that all the processes involved are regular 
enough so that Fubini's Theorem may be invoked, we obtain 



E[S t (?)] = /(<?) - / E 



ho iq, ^-(q) 



ds 



AE[S s (q)]ds 



Finally, take h = \ Yll=\Vl + V(q), V <E C°° (M"), and let $ t (q) := exp(-E[S t (<?)]). Then 



— $ t (g) = $ t (g) 



1 " 

n?) + ^E s 



i=l 



2 A ^(?)] 



This shows that the projected stochastic action St can be used to construct solutions of the heat equation 
modified with a potential term V, with initial condition given by the function exp(/) £ C°° (R n ). 



4 The Hamilton-Jacobi equation and generating functions 

One of the main features of the Hamilton-Jacobi equation is that its solutions can be used as generating 
functions of time-dependent symplectomorphisms that transform the original Hamiltonian system in 
such a way that its solutions can be easily written down. The goal of this section is spelling out the 
way in which this classical procedure can be extended to stochastic Hamiltonian systems. 
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4.1 The deterministic case 

We start by recalling the relation between the Hamilton-Jacobi equation and the generating functions 
for integrating canonical transformations in the classical deterministic case. In the next paragraphs we 
will write down some classical results in a form that is well adapted for the subsequent generalization to 
the stochastic case. All along this section we will consider Hamiltonian systems on cotangent bundles 
(T*Q 1 oj = —d8) endowed with their canonical symplectic forms. 

Consider the manifold T*Q x T*Q endowed with the symplectic form 17 := t*u> — t%u), where 
Tj : T*Q x T*Q — » T*Q, i = 1,2, denote the canonical projections onto the first and the second factors, 
respectively. Let now t/j : T*Q — > T*Q be a smooth function. It is easy to verify that the map "0 is a 
symplectomorphism if and only if c^D, — 0, where : T*Q x T*Q is the inclusion of the graph 

of ip ( |AM781 Proposition 5.2.1]), in which case is a Lagrangian submanifold of T*Q x T*Q. Given 
that £1 = — d9, with 6 = t*6 - t^O, we have that = tlQ = -tl (d0) = — d(t^G) and hence by 
Poincare's Lemma, we can locally write A® = dS, for some function S € C°° (Lr 1 ). We will say that 
S is a local generating function for the symplectic map ip. In addition, suppose that 

r :T*Q xT*Q -> Q x Q, t = ttoti x jtot 2 (4.1) 

with 7r : T*Q — > Q the canonical projection, is a local diffeomorphism when restricted to and denote 
its (local) inverse by r _1 : Q x Q — > L^. We will suppose throughout this section that this is the case 
and we will think of the generating function S £ C°° (L^j as a function defined on Q x Q; that is, we 
will not distinguish between S and (r™ 1 )* S. With this convention, we can write 

d QxQ S=(r- 1 )*o^(e). (4.2) 

Let now {ip t }teM be a family of symplectomorphisms depending smoothly on t 6 R (for example 
{"0t}teR could be the flow of a Hamiltonian vector field) and let S : R x Q x Q — » M be the corresponding 
generating functions associated to this family. We will say that t/j t transforms a vector field X 6 
X(T*Q) to equilibrium if Tip t (X) = for any t G R. For example, if X = Xh is the Hamiltonian 
vector field associated to a Hamiltonian function h € C°° (T*Q) and ^ transforms X/j to equilibrium, 
then the integral curve 7 of Xh with initial condition z is 

7t = V'" 1 (V^o (^) , t) 

where _1 is the inverse of the diffeomorphism ip : T*Q xR^ T*Q x R given by (z,t) 1— > (0 f (z) ,i). 
The main goal of the classical Hamilton-Jacobi theory in this context is proving that tp transforms Xh to 
equilibrium if, roughly speaking, its generating function S satisfies the (deterministic) Hamilton-Jacobi 
equation. As we deal with time-dependent transformations ip t of the phase space, the time-dependent 
Hamiltonian formalism is more convenient. 

Time-dependent Hamiltonian systems. Recall that, for time-dependent Hamiltonian systems, 
the phase space T*Q is replaced with the extended phase space R x T*Q. Given a time-dependent 
Hamiltonian function h E C°° (R x T*Q), one introduces flh G il 2 (R x T*Q) as il h = dh A dt + u, 
where oj G £l 2 (T*Q) is the canonical symplectic form and t denotes the global time coordinate in R. 
Observe that £lh is exact, tth = —d6h, where Oh = 8 — hdt and 9 is the canonical Liouville one form 
on the cotangent bundle. Then, the Hamiltonian vector field Xh G X (R x T*Q) is characterized by the 
two equations 

i Xh n h = o, T^{x h ) = ^ t , 

where 7Tr : R x T*Q — > R is the projection onto the first factor. 
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Sometimes it is more convenient to encode time-dependent Hamiltonian systems as autonomous 
Hamiltonian systems on the symplectic manifold E := T* (R X Q) = T*R x T*Q: let (t, u) be global 
coordinates for T*R, that is u is the conjugate momentum associated to the time t, and denote by 
ttrxT'Q ■ T*R x T*Q ->Mx T*Q the projection ((t, u),z)^ (t, z), with z e T*Q. It is straightforward 
to check that the Hamiltonian vector field Xh* associated to the function h* :— u+tt^ xT ,q (h) € C°°(E) 
is such that T , 7Tr x t*q (Xh*) — Xh- In other words, any time-dependent Hamiltonian system may 
be visualized as an autonomous Hamiltonian system by replacing M. x T*Q by E and h by h*; the 
integral curves of the original system Xh are simply obtained form the integral curves of the autonomous 
system Xh* by dropping the additional degree of freedom u, which is irrelevant as far as the dynamical 
description of the system is concerned. The following proposition deals with a time-dependent family 
of symplcctomorphisms {^At} tGR of T*Q in the enlarged phase space E and will be useful in order to 
transform time-dependent Hamiltonian systems. 

Proposition 4.1 Let {i/'tltgR be a family of symplectomorphisms ofT*Q and S £ C°° (R x Q x Q) its 
generating function. Define 

$ : E — > E 

(t,u,z) 1 — > (t,u,ip t (z)) , 

where t G R, u £ R, z £ T*Q, and 

J t :T*Q — > QxQ 

z ,— > (n(zU(Mz)))- [ ' 

Then, 

(i) lue = ip* (^e) + d o J o 7Tr x t*q) A dt, where loe denotes the canonical symplectic two form of 
E = T*(RxQ). 

(ii) ip* (u>e) is non- degenerate and, for any a 6 Q (R x T*Q) and any h € C°° (R x T*Q), 

(dS \ * 

/i o t/^ 1 + — o J t o j (wf 7Tr x t*Q («)) °V> 

Proof. (i) Let ((£, u) , (q l ,pi]i — 1, be local coordinates on a suitable open neighborhood 

U Q E. It is immediate to see from (I4.2p that for any z £ T*<3 



95 9S 1 

Pi (2) = (t, Jt (z)) and ^ (ipt(z)) = (t, J t (2)) , 

i = l,...,n (see, for instance, (7.9.1) in [MR99]), which implies that the canonical one-form 6e '■= 
udt + Y^i=i Pidg 1 locally equals 

dS 

1p* (Oe) + dS O J O 7T RxT .Q - — O J O TT RxT 'Qdt 

(see, for instance, (7.9.5) in |MR 99j ) . Applying — d to this expression, the result follows. 

(ii) By (i), (V^" 1 ) we = loe + d o J o 7Tr x t*q ° A dt. In order to simplify our notation 
let F := f o J f o^r 1 . Then, using {dt, du, dq\ dpi} i= i,...,„ and {Jj, ^, ^7, ^r}i=i,...,„ as bases of 
T^fJLJ and T^ m ^U respectively, we have the relations 



j- 1 )* {dt) = wf(di) 



(( 



(4.4) 
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which easily shows the non-degeneracy of (ip 1 ) u>e- 

Let now g £ C°° (R x T*Q), a e (1 x T*Q), and g* = u + 7r* xT , Q ( 5 ). Using ijO]) , it is straight- 
forward to check that 



= d(< 7 + F)* w f K xr , Q (a)) 



Additionally, for any m <E U C £7, the following diagram commutes: 

of (m) 



((^- 1 )*^ B )*(V;(m)) 

Therefore, by gU), for any /? G Q (£) and any /i G C°° (R x T*Q), 



dh* 



cj* o (m) = dh* (m) |w£ (m) [T,*J (/3 $(m)))] 



d/i* (m) 



((Vr 1 )*^) $(m))[j8$(m))] 
((^V) (Vi(m)) ((^ 1 )*^) # (^(m)) [/3(^(m))] 
((^ 1 )*^) # (^(m)) [/3(^(m))] 



(4.5) 



(4.6) 



In addition, if /3 is of the form ""r x t*q( Q! ) f° r some a G fi (R X T*Q), by (|4.5|) with g = (ip 1 )*h we 
have 



° 07r RxT*g(a) M= d ((($ X ) ^ + ^) J (V>M) (wf °7r£ xT . Q (a)) (V>(m)) 



dh* 



Since f = ^ o J ( o ^ 1 , the expression in (ii) follows. 



Proposition 4.2 Let ft, G C°° (R x T*Q). With the same notation as in Proposition \4-l\ a curve 
7 : [0, T] — > R x T*Q is a solution of the Hamiltonian system defined by h if and only if for any family 
of symplectomorphisms {ipt}teM. of T*Q, the curve ip o 7 : [0, T] — > R x T*Q such that (ip ° 7) (t) := 
(i, V't *s a solution of a Hamiltonian system with Hamiltonian function 



h! = h o i/> 1 + ^ o J o v3 _1 
at 

where S G C°° (1 x Q x Q) is tte generating function of {ipt} t£ ^- 



(4.7) 



Proof. Let 7 : [0,T]^KxT*Qbea solution of the time-dependent Hamiltonian system defined by 
h. Let 7:[0,T]^E = r(Mx Q) be the curve such that 7 = ^ x t*q{i) an d u = 75! (7), u being the 
conjugate momenta of the time coordinate i. Then 7 is a solution of the time-dependent Hamiltonian 
system defined by h G C°° (R x T*Q) if and only if 7 is a solution of the autonomous Hamilton system 
on the phase space E with Hamiltonian function h* = u + 7Tr x t*q(^)- By (|2.3p . this means that for 
any/Jefi(£), 



Tl[o,t] 



P = - dh*(u*(f3)) o 7 ( s )ds 



(4.8) 



Lazaro and Ortega: The stochastic Hamilton-Jacobi equation 



15 



for any t £ [0, T]. However, since we are not interested in the evolution of u, the conjugate momentum 
of the time, verifying that 7 is a solution of the time-dependent Hamilton equations is equivalent to 
taking any curve 7 such that 7 = ti"kxt*q(7) an< ^ checking that (|4.8|) holds for any differential form of 
the type tt^ xT , q (a), a £ (R x T*Q). 

Let now {"0t}teR be a time-dependent family of symplectomorphisms of T*Q and consider ?/> : 
R x T*Q -> R x T*Q such that = (i,Vt (?)), (*, z) G R x and tp E -> 7? such that 

^ (t, u, z) = (t, tt, -0* ( z )) as in Proposition ^. II Let ^07 : [0, T] — ► _E be defined as (V>°7)( s ) := ^(7(3)). 
Then 



^RxT'Q («) = / 0* ( 7r lxT*Q («)) = - / d/l * ( w l V^OrxT-Q («))) ° 7(s)c?S 

J % , t] ' Jo ^ J 

= - y d f o + — o J o V^ 1 J (wf (7rJ xT , Q (a))) o o 7) (s)rfs 



where Proposition ^. II (ii) have been used in the last equality. Hence, we conclude that 7tr x t*q(V' 7) — 
■0O7 is a solution of the time-dependent Hamiltonian system given by (?p~ 1 )*(h + ^ o J). The converse 
is left to the reader. ■ 



The content of Proposition ^. 21 can be restated as follows. Given h G C°° (R x and a family of 

symplectomorphisms {ip t }t£Wi, there exists a smooth function h! G C°° (R x T*Q) such that O/j = ^1*0^/, 
where Q^/ = d/i' A di + w and /i' is given by |T7|) (see [MR99I Section 7.9]). Furthermore Tip' 1 (X h ) 
is the Hamiltonian vector field related to h' and the flow of Xh> restricted to the phase space T*Q is 
(fit — V^ -1 OL Pt°4'o where, as usual, ip denotes the flow of symplectomorphisms of the Hamiltonian vector 
field Xh G X(T*Q). However, as we will be interested in transforming Xh using Tip rather than Tip" 1 
we will rewrite (|4.7p in the form 

dS 

h'(t,M*)) ■=h(z) + — (t,J t oz). (4.9) 
ot 

Definition 4.3 Let h G C°° (T*Q) be a Hamiltonian function and let (q l ,pi;i = 1, ...,rt) be local Dar- 
boux coordinates on T*Q. Regarding h as a function of these coordinates, we will say that the generat- 
ing function S:MxQxQ->l satisfies the (deterministic) Hamilton-Jacobi equation if the function 
K :Rx Q x Q -> R 

f dS \ OS 

K t (qi,q2)-^h\ [ q 1 , — {t,q 1 ,q 2 )\+ — (t,q 1 ,q 2 ), (qi,q 2 ) £QxQ (4.10) 

does not depend on the first entry q\ G Q. 

Observe that in the right hand side of (|4.10[) we have carried out the substitution {jpi)i = §^r(t, ?i> Q2), 
i = 1, ...,n. We could also write (|4. 10[) more intrinsically as 

dS 

h(d Ql S (t,qi,q 2 )) + (t, qi, q 2 ) 

where, for a fixed value (t, q 2 ) G R x Q, we consider dQj5 (t, q\, q 2 ) as an element in T* ± Q. 

Notice that the map J* introduced in (|4.3| is a local diffeomorphism for any t G R because we 
required the projection r defined in (|4.1|) to be a local diffeomorphism when restricted to the graph of 
ipt- We may therefore (locally) write any z £ T*Q as z — J^ 1 (qi,q 2 ) for some suitable (qi, q 2 ) £ Q x Q. 
The important point is that J t _1 (qi,q 2 ) = Aq 1 S (t, qi, q 2 ) ( MR991 (7.9.1)]) and, consequently, the 



Lazaro and Ortega: The stochastic Hamilton-Jacobi equation 



16 



transformed Hamiltonian h' in (|4.9p can be seen as a function on R x Q x Q. Explicitly, ii z = ip t (z) £ 
T*Q, 

dS 

h'(t,z) = h(d Ql S(t, qi ,q 2 )) + — {t,qi,q 2 ), (4.11) 

so h' (t, z) equals the function K t (q%, q 2 ) introduced in Definition 14.31 Suppose now that S : M. x Q x 
Q — > R is a solution to the Hamilton-Jacobi equation. In other words, K t (91,92) = K t (q 2 )- Since 
q 2 = 7r (ipt {z)) is the base point in the configuration space of the transformed point ipt (z), z G T*Q, 
we conclude that h! does not depend on the fiber coordinates. Hence, removing the subindices, the 
Hamilton equations associated to the new Hamiltonian h! are 

dK 

q = 0, p t = -—(t,q), i = l,...,n, 

which are easily integrable. In particular, if K is independent of both q\ and q 2 , then ip t transforms X% 
to equilibrium. 



4.2 The stochastic case 

We are now going to see that the classical Hamilton-Jacobi that we just outlined has a stochastic 
counterpart. More specifically, one may use a time-dependent family of symplectomorphisms and their 
generating function to transform a stochastic Hamiltonian system into another one in much the same 
fashion as in the deterministic case. The strategy consists of finding and characterizing a suitable 
generating function so that the new Hamiltonian system is easier to solve. 

Let T*Q be the cotangent bundle of the configuration space manifold Q and let {ho, hi, h r } C 
C°° (T*Q) be a family of functions. Take a K r+1 -valued semimartingale X : R+ x Q -> R r+1 such that 

X = (X°,X 1 ,...,X r ) , with X° = t a.s., (4.12) 

and consider the stochastic Hamiltonian system on T*Q with Hamiltonian function h := (h$, hi, h r ) 
and stochastic component X. If we want to remove the assumption that there is a Hamiltonian vector 
field, i.e. Xh , playing the role of a deterministic drift, we may simply choose ho = 0. 

Using an approach similar to the one in Section |4~T1 we will work in the extended phase space E := 
T* (R x Q). Indeed, it is easy to check that the solution semimartingales of the stochastic Hamiltonian 
system can be obtained out of the solutions of the stochastic Hamiltonian system on E with Hamiltonian 
function h = {h^, "rxt'-qCii), 7r R X T*Q(^ 1 ^)) an( ^ stochastic component X; notice that the functions 
ho, hi, h r have already been considered as functions on R x T*Q instead of only T*Q. The solutions 
of the original system can be recovered by composing the solutions of the Hamiltonian system on E 
with 7Trxt*q- When instead of working on the space E one uses directly R x T*Q instead of T*Q then 
a T*Q-valued semimartingale T is a solution of the corresponding stochastic Hamiltonian system when 
for any aefi(rQ), 

J (a, 5T S ) = -f(dh (r^ Q o cj*(a)) (s, F s ) , SX S ) , 
where tt-q : R x T*Q — > T*Q is the canonical projection onto the second factor. 

Proposition 4.4 Let {V-'tjfgR be a time- dependent family of symplectomorphisms ofT*Q with gener- 
ating function S £ C°° (R x Q x Q). Consider -0 : R x T*Q -^lx T*Q and tp : E — > E the natural 
diffeomorphisms extending if) to RxT*Q and E respectively. Then the semimartingale T : R + xil — > T*Q 
is a solution of the Hamiltonian system with Hamiltonian function h : T*Q —> R r+1 , h = (ho, hi, h r ), 
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and stochastic component X : R + x fi — > K r+1 as m \^.V^ , if and only if ip (T) is a solution of the 
Haniiltonian system with Hamiltonian function hi : R x T*Q — » R r+1 loii/i components given by 

dS 

h' = TT* Q (h ) ° ip^ 1 + -Tj- o J o V?" 1 , 
h\ = T^, Q (hi) oip- 1 , 

ti r =T^ Q (h r )o$-\ (4.13) 

and stochastic component X . 

Proof. Suppose that T : M.+ x £1 — > T*Q is a solution of the Hamiltonian system with Hamiltonian 
function h and stochastic component X and let f : R + x f2 — ► £7 be a semimartingale such that 
7TR X T*Q(ft) = (t)Tt) E M x T*Q, t E R + . We want to check that V>(F) is a solution of the stochastic 
Hamiltonian system given by the Hamiltonian function (|4.13l) . Let a E (R x T*Q). Since T is a 
solution, we may write 



(4 xr , Q («),^(f)) = y (po*i xTmQ ( a ),sr) = -j (dh(u>* °r°^ xT , (a))(rVx) 

= -/ dftj(wf o^*o ff J xr . g (a))(f)dt-^ y dfr^gftiXa;! o ^* o ^ xT , (a))(f 

?— i 

where 7Tt*q : -E = T*R x T*Q — > T*Q is the projection onto the second factor. Now, by Proposition 
lwe have 



dh*{uj* o r o 7rJ xr . g (a))(T)dt = 

J d^Q^o^- 1 + J t o$-A (w|o TOxT .Q(a))(^(f))«. (4.14) 

On the other hand, using (j4.4[) and (|4.6p it is easy to see that for any g E C°° (T*Q) 

A i^, Q g){u* o n^ xT « Q (a))(m) = d(7r^ Q ( 5 ) o ^ _1 )(wf o 7ra xr , Q (a:))(^(m)). 
Consequently, 

dM. Q h i )(wppowl xT . Q (a))(r)5X i = J d( 7 r*, Q (^)or 1 )( [i ;|o 7 r* xTtQ (a))(V;(f)) ( 5^, (4.15) 
for any i = 1, ...,r. Combining (|4.14|) and (I4.15P we obtain that 

(*JxT.g(a).^(F)) = - y d^-g^of 'i^oJto^j ( w f o ^ ExT .q (a)) (^(f )) <ft 

d(7r^ (^) o ^(wg o < xT , Q (a))(V;(f))5X i ) 



which means that ijit (Ft) is a solution of the time-dependent stochastic Hamiltonian system with stochas- 
tic component X and Hamiltonian function (|4.13p . The converse is left to the reader. ■ 
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The system (|4. 13[) may be written as 

dt 



dS 

h' (t,7p t {z)) = r|., Q (/i ) (d Ql S (t,qi,q 2 )) + — (t,qi,q 2 ) 



Kit, Mz)) = r^ Q {hx) (d Ql S(t, qi ,q 2 )) 



K(t,Mz)) = r* T , Q {h r ) (d Ql S(t, qi ,q 2 )) (4.16) 

where, as in (|4.11[) we have written z G T*Q as z = J t _1 (91,92) for some suitable (qi,q 2 ) G Q x Q. In 
addition, if the generating function S is such that the right hand side of (|4. 16|) is independent of the 
variable q\, that is, 

dS 

t T«q(^o) (dQiS (t,qx,q 2 )) + — (i, 91,92) =: K Q (t,q 2 ) , 
T T*Q( h i) (d Ql S (t,q 1 ,q 2 )) =: K 1 (t,q 2 ) , 



t*, q (K) (d Ql S(t, qi ,q 2 )) =: K r (t, q 2 ) , (4.17) 

then the stochastic Hamilton equations of the transformed system may be expressed in local coordinates 
as 

Sq i = 

The next result is basically due to Bismut (see [B81 ( Theoreme 7.6, page 349]). 
Proposition 4.5 In the conditions of the previous proposition, if |J7?J) holds then 

{hi,hj}(z) = 



BK 

{h ,h l }(z) + ^(t,n(Mz))) = 



locally for any 1 < i,j < r. 



Proof. Suppose that there exists a generating function S G C°° (R x Q x Q) such that the equalities 
(|4.17p are satisfied. We take a fixed point q 2 G Q and write Kf 2 (t) instead of K% (t,q 2 ), i = 0, r, and 
S Q2 (t,q) instead of S(t,q,q 2 ). Consider the following family of functions of the extended phase space 
E = T* (K x Q): 

.go = u + TT^, Q (h ) - Kf (t) 

9l =-K^ Q {h 1 )-Kr (t) 



g r = n^ Q (h r )-K? (i), 

where u denotes the conjugate momentum of the time coordinate t in E. The functions go,...,g r C 
C°°(-E) vanish on the Lagrangian submanifold Ls G E locally defined by 

f 3S q2 8S q2 

L s = Ut,u,q,p) eE \ pi = -z—(t,q), u = —^-{t,q) 
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Given that if a family of functions is locally constant on a Lagrangian submanifold, then their Poisson 
brackets must vanish on it, we have that {<?i,<?j} = for any < i,j < r. Equivalently, 



ttt*q ({ho,hi})\ T 



L - "T*Q 

dKf 



tt* t , q ({hi,hj})\ 



dt 



(4.18) 



for any i, j = 1, ...,r. In particular, since the inverse Jf : Q x Q — » T*Q of the local diffeomorphism 
introduced in (|4.3[) is such that z = J^ 1 (qi, q 2 ) = (qi, dS q2 (t, qi)), we have the freedom to chose q 2 so 
that z — Jf 1 (qi, q 2 ) is a point in the fiber of q\ G Q. With this choice (|4.18|) implies that 

{/»0, fti} («) + (*) - {AO, ^} (») + ^ = 



for any z e T*Q. 
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